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Abstract 

This article provides a comparison of the successive lumping (SL) methodology 
developed in |19| with the popular lattice path counting |24| in obtaining rate 
matrices for queueing models, satisfying the specific quasi birth and death 
structure as in m, |22| . The two methodologies are compared both in 
terms of applicability requirements and numerical complexity by analyzing 
their performance for the same classical queueing models considered in |21| . 

The main findings are: i) When both methods are applicable the SL based 
algorithms outperform the lattice path counting algorithm (LPCA). ii) There 
are important classes of problems (e.g., models with (level) non-homogenous 
rates or with finite state spaces) for which the SL methodology is applicable and 
for which the LPCA cannot be used, iii) Another main advantage of successive 
lumping algorithms over lattice path counting is that the former includes a 
method to compute the steady state distribution using this rate matrix. 
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1. Introduction 

Two dimensional Markov chains arise as a natural way to model various real life 
applications. In particular, many queueing models possess this structure and it is even 
possible that a more complex, higher dimensional queueing model can be decomposed 
into various two dimensional Markov processes. For various queueing models we refer 
to [HiaEligEllilEllEglEIllM]- Other areas in which these processes will arise 
outside queueing are for example inventory models, cf. |18| . reliability, cf. [13 [m and 
pricing models. In this paper we are particularly interested in a comparison of the 
new successive lumping (SL) methodology developed in |19| with the popular lattice 
path counting |24| in obtaining rate matrices for queueing models, as in |22| and m- 
The two methodologies are compared both in terms of applicability requirements and 
numerical complexity by analyzing their performance for the same classical queueing 
models considered in [21]. In all these models, the objective is to calculate the steady 
state distribution of a pertinent Quasi Birth-and-Death (QBD) process (i.e., a two 
dimensional Markov chain with a transition generator matrix Q that contains nonzero 
rates only for transitions to the ‘left’ and to the ‘right’ in every state) that describes 
the evolution of the state of the system in time. 

The main method that is used to analyze QBD processes is based on expressing 
the stationary probabilities of states of one level in terms of those of its previous 
levels. This is done with the aid of a rate matrix R, which is the basis of the matrix- 
geometric solution introduced by Neuts. For general level-independent QBD processes, 
it is known that R satisfies a matrix-quadratic equation. Algorithms for solving this 
equation were given in |26j and Latouche and Ramaswami |20| . A current state of 
the art software implementing quadratically-convergent algorithms with a number of 
speed-up features is described in |4]. A general algorithm for the level-independent 
case can be found in |6] and a discussion of the Quasi Skip Free case in |23] . 

There are various methods that make use of a special structure of the transition rate 
matrix Q, to provide efficient computation procedures for the rate matrix R. Such a 
procedure is available in the the case in which the ‘down matrix’ of Q, is a product 
of a row and a column vector. For other procedures that explicitly calculate a rate 
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matrix we refer to m and [2S]. Recent studies, cf. [21 mi, have used lattice path 
counting methods to directly compute the rate matrix for certain QBD processes that 
arise in queueing models. For example, a priority queue model has been analyzed by 
this method, but also with other techniques, see e.g. m and references therein. The 
idea of counting the number of paths on a lattice, cf. Ellin], has been used in many 
fields of applied probability, cf. |28| . 

A new alternative method to compute the rate matrix for certain QBD processes can be 
based on the successive lumping (SL) procedure introduced in [14] . It was employed 
in m to obtain explicit solutions for ‘rate sets’ for large classes of QSF processes, 
the so-called DES and RES processes. The SL approach differs from the previous 
mentioned works by its distinct method of derivation and its applicability to models 
with inhnite state spaces and models that are outside the QSE framework. However, it 
should be noted that algorithms given in iHEniis] can be used on other, more general 
(in terms of down-transitions) processes. The advantages of using SL are described in 
nni- Although the nature of a path counting based method and the successive lumping 
based method are very different, a comparison can be done, since they both rely on 
the absence of certain kind of transitions. Herein we compare the method introduced 
in |21| with the one based on successive lumping of m- 

The main contribution of this paper is to provide a clear comparison between successive 
lumping (SL) based methods and the lattice path counting based algorithm, introduced 
in |21| . in computational complexity and applicability. Eirst, it is shown that the SL 
methodology yields algorithms that are faster than the counting algorithm. Second, we 
show that SL based procedures are applicable to many of the queueing models discussed 
in previous papers, and even to models with finite state spaces or with non-homogenous 
transition rate structures and to models with a quasi skip free (QSF) structure, cf. |19| . 
However, there seem to exist some artificial queueing models that do not possess the 
SL property, for which a lattice path counting algorithm is applicable. Finally, this 
paper continues the work of |19) . and it specializes its results to homogenous QBD 
processes, in order to make the comparison of successive lumping (SL) based methods 
and the lattice path counting procedure possible. 

The paper has the following structure. In Section [2] we first define the notation for the 
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QBD processes that we will use throughout the paper. In Section [5] we summarize 
the results of m for the DES processes as they apply to quasi birth and death 
processes with a down entrance state and the resulting quasi birth and death down 
entrance state algorithm (QDESA). In Section [5] the QDESA procedure is specialized 
depending on the structure of the transition rate Q, applicable to the models under 
investigation in this paper. Then, in Section [3] the introduced procedures are clarified 
by applying them to two specific queueing examples. In Section |4] we review the 
lattice path counting algorithm. In Section [S] we compare the procedures in speed 
(computational complexity). In Section [5] we discuss the the type of models for which 
each procedure can be applied. We conclude with some models that further illustrate 
these comparisons. 


2. Preliminary Results 

2.1. Successive Lumping in Quasi Birth and Death Processes 

In the sequel we consider an ergodic QBD process X{t) with states in a finite or 
countable set X. The states (after re-labeling) will be written as tuples where 

in the state description the first entry m = 0,1,..., M represents the ‘level’ of the state 
and the second entry i = 0,1,2,... ,£m represents the ‘stage’ of the state (m,*). The 
integers and M are given constants and they represent respectively the number of 
stages {£m + l) and the highest level (M); these scalars can be infinite. Let Q denote the 
transition generator matrix. The process X{t) is referred to as a ‘level QBD’ process 
if the only transitions allowed are to a state that is within the same level or to a level 
one step above or below, i.e., Q has the form: 

W° U° 0 ■ • • 0 

0 

0 0 

V — 

0 0 0 ■ • • IT^-1 t/^-i 

0 0 0 ■ • • 


0 

0 
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The matrices W, D and U represent ‘within a level’, ‘down one level’ and ‘up one 
level’ transitions respectively. The sub-matrices above are of dimension {im + 
1) X [Im + 1), the sub-matrices D'" are of dimension [1^ -I- 1) x {im-i + 1) and the 
submatrices U’” are of dimension (£m + l) x (£m-i-i + l)- Further, we will use the notation 
= {{n, i), i = 0,1,..., £} for the level sets (n = 0,1,..., M). 

Let TT denote the steady state distribution, i.e., the solution of ttQ = 0 and ttI = 1. We 
denote by tt" the sub-vector of tt formed by the stationary probabilities of the states 
of level n i.e., tt"- = [7r(n, 0),.. ., 7r(n, £) ]. 

In the context of the current paper we will assume that every matrix has only one 
nonzero column (that for this section we will assume be the first column). The under¬ 
lying QBD process is therefore successively lumpable (a DES process) with respect to 
the partition {/l„}n>o of the state space X, cf. El for lumping and El for a proof 
that X (t) is lumpable with respect to this partition. In addition we will assume that 
i for all m (i.e., the level size is independent of the level) and note that this 
condition is not necessary for the DES procedure to be applicable, but is necessary 
for the LPC procedure, that will be discussed in Section 01 Below we will repeat the 
important definitions from m, specialized for a QBD process. 

In a QBD process we define the matrix [7™ of size (-^ + 1) x (£ -|- 1) as follows: 

c7™ = (2) 

where Im is a rowvector of size 7-1-1 with identically equal to 1 and Sm is a vector of 
the same size identically equal to 0 with a 1 on its first entry. Furthermore we define: 

B^ = W"^ + U^. (3) 

For a QBD process, we will call a matrix set that satisfies the equation below 

a rate matrix set. 

TT™ = , for m = 1,..., M 2 . (4) 

In UH] it was shown that the matrix is invertible. A simplification of Theorem 
2 of that paper for the special case of a QBD process implies that the matrix set 
TZo := {Rm}m defined by: 
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is a rate matrix set for Q, when has a single nonzero column. 

Remark 1. 

i) Note that Eq. (|4]) and Eq. (|5|) imply that the following recursive relation holds for 
all z/ = 0,..., m — 1: 

m 

fc — 1/+1 

ii) It is easy to see that the above defined tt"* and Rm satisfy the non-linear Eq. (12.2) 
of pUj. The matrices Rm are solutions to Eq. (12.11) of the same book, given there 
but without the explicit procedure of Eq. ([S]) to compute them. 


To obtain the steady state distribution, tt = [7r°,7r^,...], one only needs to compute 
7r°, which per Theorem 3 of m. is given by Eqs. © - (|5]) below. 


= Sn 


S^^So - B° 


(7) 


where 

M2 m 

S^^ = l'o+J2l[Rkl'm- ( 8 ) 

m—1 k—1 


The procedure to calculate the steady state distribution tt when there is a down 
entrance state in every level that is based on Eqs. ©, m and above will be 
referred to in the sequel as the quasi birth and death down entrance state algorithm 
(QDESA). 

2.2. Solution Procedures for Specific QBD processes 

Unless otherwise stated in the remainder of the paper we will consider homogenous 
level processes. Note that for these processes B’^ = B = W + U (defined in Eq. ©) 
for all TO. Depending on the structure of the matrix B we define two subclasses, of 
decreasing generality, of the QDESA procedure. First, we identify homogenous QBD 
processes with a down entrance state where the matrix B is of countable dimension 
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and has the following form: 


B = 


— h^ — 

% % 


bf 


b^2 

bl 

bl 


^0 

-bf 

hi 

0 

0 


0 

hi 


0 

0 

hu 

— IP’ 

lA 

O 4 


0 

0 

0 

bi 


where 


bf = bf 


6“ 

I 


(9) 


and these elements bf are nonzero for a G {w, z, d, m}. The procedure to find the steady 
state distribution of these processes will be referred to as QDESA’*'. 


Second, we consider homogenous QBD processes with a down entrance state where the 
matrix B has the structure of Eq. m and is element homogenous i.e., 


bf = for alH = 0,1,... and a G {z, d, w, u}. 


In this case the procedure to find the steady state distribution tt will be named 
QDESA'^+. 

In [TS] we present a fast 0{£'^) algorithm to compute the inverse of matrix B of Eq. (jH]), 
when it is element homogenous, and thus used in QDESA’*'^. In that same paper we 
described a procedure with the same complexity to compute the inverse of B, when 
it has the structure of Eq. ([S]) and it is not required to be element homogenous. An 
alternative method of computation with the same complexity is given in m. pp. 62, 
but only if < 00 and B is element homogenous. 


Remark 2. One can determine which solution method is applicable by inspection of 
the matrix Q. If IT™ has a birth and death structure, QDESA’*' is applicable, and 
when both W and U have a homogenous birth and death structure, QDESA’*’^ is 
applicable. 


When W has another structure than the one described above, it might still have a 
sparse form. In that case it might be beneficial to use other fast matrix inversion 
algorithms, like in [12] and |33| . 




KATEHAKIS ET AL. 


In the rest of this paper references to QDESA include the special cases QDESA'*' and 
QDESA“''^ as well and it is assumed that the most efficient form QDESA is always 
applied. 


3. Applications: Classic Queueing Models 

In this section we will discuss two classical queueing models and analyze how the 
procedures above can be used to compute the steady state distribution. The Priority 
Queue will be discussed in detail, and the Longest Queue more briefly. To avoid 
confusion we will use when necessary the notation and to distinguish a matrix 
A associated with the priority model of Section [O] or the longest queue of Section 15^ 
respectively. 

3.1. The Priority Queue 

In the priority queue model customers arrive according to two independent Poisson 
processes with rate for queue i = 1,2. There is a single server that serves at 
exponential rate p, independently of the arrival processes. The server serves customers 
at queue 2 only when queue 1 is empty, preemptions are allowed and server switches are 
instantaneous. Under these assumptions the state of the system can be summarized 
by a tuple {n,j) where n (respectively j) is the number of customers in queue 2 
(respectively in queue 1). 

It is easy to see that Q is the transition rate matrix of a DES process, in fact a 
homogenous level QBD process with M = oo; the level sets £„ and their entrance 
states (n, 0) are illustrated in Figured) 

Since there is no maximum for the number of customers in queue 1 the sub-matrices 
D, W and U have infinite dimension {£ = c») and the representation below, where 
d = (Ai + X 2 + fJ,)- Note that Wq is obtained from W by replacing d in its (0,0) 
position by (Ai -I- A 2 ), since in state (0,0) there are no customers in service. 
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Figure 1: Transition diagram of the priority queue model. 
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0 

1 
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0 

II 

0 
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0 
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0 0 ••• 




,w = 




0 

0 

A 2 


1 

0 










Note that in this model we have: = U = X 2 I, thus, = i?f := —X 2 B where 


B^ = 


— (Ai fj,) Xi 0 0 

A 2 ~t“ p —d Ai 0 

A2 p —d Ai 

A2 Q fjL —d 


It is clear that matrix B^ has the required structure to use the QDESA'*’^. Thus, the 
priority queue model can be solved easily using this method. 


3.2. Longest Queue 

In a longest queue model, cf. |35j . two types of customers arrive according to indepen¬ 
dent Poisson streams, each with rate A and form two queues according to their type. 
There is a single exponential server with rate ^ > 2X that severs customers from the 
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longest queue (i.e., the one having the most customers), where ties are resolved with 
equal probabilities for each queue; server queue switches are instantaneous. 

To obtain meaningful results for this model, we will use the following state space 
description that is easy to work with. At each point of time let the state be specified 
by a tuple (n,j), where j denotes the difference between the two queue lengths and 
n denotes the length of the shortest queue. A more natural state space description is 
discussed in Section 

It is easy to deduce that this is a DES process, in fact a homogenous level QBD process, 
with M = oo with level sets £„ as described in Section!^ and entrance states (n, 1) 
for level n where matrices D, U, W as given below, d = 2X + fi. We note that Wq is 
obtained from W by replacing d in its (0,0) position by (Ai + A 2 ), since in state (0, 0) 
there are no customers in service. 


0 

A 

0 ••• 


0 

0 

0 ••• 


-d 

2A 

0 • 


0 

0 

0 ••• 

,U = 

A 

0 

0 

,w = 


—d 

A ■ 


0 

0 

0 ••• 

0 

A 

0 

0 


-d ■ 


- 













Since C/° = U, the rate matrices and R for this model are equal, i.e., Af = R^, as 
in the previous models and the matrix B in this model has the following form: 




-d 2X 0 0 

/i —A A) A 0 
0 /X A A —d X 
0 A ^ —d 

0 A 0 /X 


Note that the matrix B^ has a structure similar (but not identical) to that of B defined 
in Eq. its structure from the second column on is identical to that of B, but an 
extra column has been added in front. This can be easily resolved with a suitable 
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modification of QDESA'*’’*'. 

Remark 3. The Feedback queue, the third model that is discussed in [^, fits the 
QDESA framework as well; its analysis goes analogous to the analysis of the priority 
queue. 


4. Lattice Path Counting 


A different approach to compute the steady state distribution tt for a class of Markov 
process that includes the queueing models described before, is the Lattice Path Count¬ 
ing Algorithm (LPCA) of [H], see also [5T]. In this section we will repeat LPCA in 
the notation used in this paper. 

Throughout this paper we use a labeling of states that is consistent with our notation 
introduced in [T3] and (TH]- In [H] a similar tuple notation was used, but the meaning 
of the first and the second element is reversed. For example, in the priority queue 
model of Section 3.1 we denote a system with two queues with n customers in queue 
2 and i in queue 1 as {n,i). This same (n,i) in m denoted a system with two queues 
with n customers in queue 1 and i customers in queue 2. 

Recall that we used the level (first coordinate) sets £„ = {{n,i), i = 1,... ,£} where 
n = 0, 1 ,... to define a partition with respect to which the studied processes are ‘level 
QBD’ processes. A ‘stage QBD’ process can be defined analogously; one can rearrange 
the states of X in the order of stages (second coordinate), i.e., as (0,1),..., (M, 1), 
(0, 2),... (M, 2), ..., {M,£). In this case we define the stage sets to be: 

ICi = {(n,z), n = 0,1,...}. Transitions are allowed one stage up and one stage down 
to preserve the QBD property in the direction of stages. Using a stage partition, we 
obtain the following representation of the transition generator matrix, which will be 
denoted by Q to indicate that a stage partition is used: 


Q 


Bi Bq 0 
A2 Ai Aq 
0 A 2 Ai 
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where the dimension of the above sub matrices is M x M. 

The matrix Q in the current paper is the same as the matrix Q of EB, subject to 
appropriate relabeling of states, as is mentioned above. Note that in this paper the 
notation M is used for our £ above and their corresponding I is infinite. 

Following the approach introduced in m, a process X (t) is called Lattice Path Count¬ 
able (LPC) if the following three conditions hold: 

i) When j > 1, the only transitions allowed from state (n, j) are to states: {n + 
ei, j + 62 ) G T where ei G {0,1} and 62 G { — 1,0,1}; 

ii) When j > 1, the transition rate Q{{n,j) , (n -|- ei,j -|- 62 )) is a function of the 
jump size and direction only, i.e., 

{n + eij + e2)) = 9 ( 61 , 62 ); ( 10 ) 

hi) The process is a stage QBD process where i is infinite and M is finite or infinite. 

In the previous section we described a rate matrix R that provides a relationship 
between the steady state distributions of the different levels. A similar recursion can 
be defined for the steady state vectors tti for stage i > 0 : Tr^+i = iTiR, 

where R is the minimal noimegative solution to the matrix quadratic equation: Aq -\- 
RAi + R^A2 = 0 . 

We have denoted the rate matrix constructed with LPC as R to distinguish it from 
the matrix R used in Eq. m above. 

Figure [2] displays a simplification of a transition diagram of a process that is a QBD 
process with respect both to the levels and to the stages. The LPCA can be applied 
with respect to the stages. 

Further, it is known, cf. for example |20| . that the elements f(n\m) of the matrix 
R = [f(n|m)] represent the expected taboo sojourn time in (n,i + 1) before the first 
return to stage i given that the process starts in (m, i) multiplied by the sojourn time 
in stage i, for any i >1. Since the LPC assumption above does not allow transitions 
in the downward direction and has a homogenous structure by point ii) above, the rate 
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Level 



Level 



Stage ACi 




Stage ACo 


Figure 2: Levels and Stages, 
matrix is upper-triangular and has the following form: 


^0 ri r2 


R = 


0 fo fi 
0 0 fo 


Theorem [T] below provides an explicit expression for the elements of R. It is the main 
result of m and uses the following expressions: 


P„(s, u, m) = <^(1, 0) V(l, 1)X0,1)’"-X0, 

1 (2w\ f m-\-l\ fm\ f 2m + 

s 


Lh{s,u,m) = 


u J \ t 


m+ l\m 

h h — s oc 

Gh = EE E Lh{s,u,m)Phis,u, 

s—0 u=0 ?7i=max(ii,s —1) 


m 


( 11 ) 


Kh = 


cj){l, 0)Kh-i + 1) Gh-jKj + cj){l, 1) Gh-j-i 


j =0 


l-</.{0,l)Go 


where po = 1 ^'iid p_i = 0 and 0(ei,e2) denotes the transition probability from state 
(n, j) to state {n + ei, j -I- 62). 


Theorem 1. The upper diagonal elements fh of R can be expressed as follows: 

4>{0, l)Kh + ^(1, ^)Kh-l 


fh=2 


( 12 ) 
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The LPCA is based on the calculation of Eq. m, utilizing a new computation of the 
Gh in Eq. (fTTl) above using hypergeometric functions, cf. Eq. (26) and (27) of [5T]. 

5. Comparative Analysis 

In this section we will compare the efficiency of LPCA and QDESA described in the 
previous section. To make a fair comparison between these algorithms we will compare 
their complexities in Section 15.11 for transition rate matrices on which they can both 
be applied. In Section [0] we discuss classes of models for which a version of QDESA is 
applicable while LPCA is not. We will also distinguish structures for which the LPCA 
can be used efficiently, but for which QDESA is not readily applicable. 

It is important to note that LPCA is based on the existence of a ‘homogeneous portion’ 
of stages, i.e., transition rates are both stage and level independent, as is described in 
Section 5 of m and summarized in the previous section. The non-homogeneous part 
of the state space is considered to be (part of) stage ICq. This non-homogeneous part 
may induce that QDESA might not be applicable; the entrance state property might 
be violated. Exit states might still be present, for the formal definition of an exit state 
we refer to [S] . In this paper we have described how an entrance state and an exit state 
are related and how the choice of levels can be adjusted to transform an exit state 
into an entrance state. However, no applications are known for which such a complex 
structure in /Cq is necessary, that QDESA is no longer applicable. 

When a process has such a structure that QDESA applies (with respect to the levels) 
and LPCA (with respect to the stages) we note that B, (where R = UB~^) has to 
have the structure of Eq. ([5]), up to a permutation of the columns, due to the fact 
that the process is a QBD process in the stage direction, see Remark [21 Furthermore, 
it is easy to see that this homogeneous structured process implies that matrix B has 
an element homogenous structure, since the elements are independent on the stages. 
Summarizing the above, we state the following. 

Proposition 1. Suppose that the following are both true: 

- LPCA is applicable to a QBD process with respect to the stages, 
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- The set IJ^^q Ck has an entrance state or the set jC-k has an exit state. 

Then QDESA'^^ can he applied with respect to the level partition. 

A result of this proposition is that for a fair computational comparison between the 
algorithms it suffices to compare LPCA with QDESA’*”'’. 

5.1. Computational Complexity of the Procedures 

By Eq. ® we know that the computational complexity of QDESA’*’^ is determined 
by the complexity of calculating the elements of the matrix R with dimension I y. i. 
Since [7 is a sparse matrix in this case, the computationally heavy step is to invert 
matrix B. Eor LPCA the computational complexity is determined by the complexity 
of calculating the elements of matrix R. Recall that R has dimension M x M. 

The general result on complexity is summarized in Theorem!^ below. To compare the 
complexities of QDESA to that of LPCA, we take i = M, e.g. this is the case in the 
priority queue model when the queues have the same (finite or truncated) capacity. In 
the following complexity analysis we assume that arithmetic operations with individual 
elements have complexity 0{1). 

Theorem 2. When the steady state distribution of a QBD process can be found both 
by using LPCA and using QDESA the following are true: 

i) Using LPCA, the computation of the stage-rate matrix R has complexity 

ii) Using QDESA'^^, the computation of the level-rate matrix R has complexity 

Proof. To prove part i) we assign complexity of 0{h) to the computation of the 
term X]m=max(u s-i) ^his, u, m)Ph{s, u, m) that involves hypergeometric functions, cf. 
Eq. (26) and Eq. (27) of [21], noting that s -\- u -\-1 = h. The correct complexity of 
the above computation is actually higher, but this lower bound is easy to establish 
when counting conservatively. From Eq. (ED we see that to calculate Gh we need ap¬ 
proximately ih?/2)0{h) = 0{hA) iterations (a double summation). The computation 
of matrix R (of size M x M) requires the computation of all its M different nonzero 
elements, fo,... ,fM-i and each of these computations is of complexity Oih^). The 
complexity of the computation of rate matrix R is: 0{h^) = 0{M'^). 
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For part m), we will establish the complexity for the QDESA^’*'. The procedure for 
the computations of the elements of the hrst row and hrst column of C uses a single 
computation per element, of 0(1). For the remaining elements a linear expression 
has to be solved, having a complexity of 0(1) per element as well. Thus the total 
complexity of computing C is 0(^^), the number of elements of B~^. The matrices U 
have a sparse form (at most 3 non-zero elements per row), induced by the fact that 
LPGA is applicable by assumption. Since R = UB~^, the complexity of computing R 
is 0(1'^): both the complexity of the matrix multiplication UB~^ and of the calculation 
of B~^ have this complexity. The proof is complete. 

Remark 4. For some special cases, e.g. the priority queue, the complexity of LPGA is 
lower because of the absence of transitions from (n,j) to (n-|-ei,j - 1 - 62 ) with ( 61 , 62 ) G 
{(—1,1), (1,1)} for all {n,j). In this special case the complexity of LPGA is 0{M‘^), 
because in the computation of Gh , both s = 0 and u = 0 and the summation in Eq. dm 
is only over m; i.e., the complexities of LPGA and QDESA are the same in this case. 

Remark 5. When there is no additional structure on matrix B, both QELSA"*" and 
QDESA'’"''' can not be used, so we need a general matrix inversion to compute B~^ 
of dimension i hy i that is in complexity less than cf. [52], when £ is hnite. 

When ?7 is a non-sparse matrix this provides a solution procedure with total complexity 
0{l^) for QDESA. 

6. The Applicability of QDESA to More General Models 

In this section we will determine the differences in applicability between QDESA and 
LPGA, and display these differences with examples. We will consider variations of the 
queues in Section lOI and 15^ that can be solved with QDESA but not with LPGA. 

One of the main advantages of QDESA over LPGA is that QDESA not only provides 
a method to hnd the rate matrix, but the algorithm includes a way to hnd the steady 
state distribution using this rate matrix. Since LPGA does not require any restrictions 
on the non-homogenous part /Cq, the structure on this set can be very complex and a 
direct technique to do this step is absent and not trivial to include. Therefore QDESA 
can be viewed as a more complete solution procedure. And for that reason we will 
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not discuss models that have a complicated structure on /Cq ; even though it is possible 
to find the rate matrix for such a model with LPCA, but perhaps not with QDESA, 
within the LPCA no procedure is provided to find the steady state distribution. 

There are four important classes of models for which (an extension of) QDESA is 
applicable and for which the LPCA can not be used at all. The first class involves 
element non-homogenous DES processes: in this case there is no homogeneous tail 
on which the LPCA is applicable. The second class involves processes with a finite 
number of stages as described in Section [51 in the LPC case there is analysis only 
for the case in which the number of stages I is infinite. The third class involves DES 
processes with ‘down’ transitions to the entrance state in a level Lm-i from more 
than one state in level Lm for some m. The fourth and most general class involve all 
DES processes, i.e., Markov chains with transitions from an arbitrary state (n, j) to 
states: (n + ei, j + 62 ) G X where ei € {0,1,...} and 62 € {..., —1, 0,1,...}, under 
the condition of a single entrance state in the ‘down’ direction cf. m- 

Conversely, there are processes for which the LPCA is applicable, but QDESA is not. 
Such processes will contain transitions that destroy the DES property with respect 
to the level partition. For example transitions from a state (n,l) to (n — 2,1) are 
allowed in an LPC Process, but are not allowed in a DES process, when (n, 1) is the 
entrance state for every level £„■ However, by relabeling and changing the levels one 
can construct a DES process in a lot of cases. 

Tabled] identifies the difference in applicability between the two procedures. We note 
that the transitions within the heterogenous stage /Cq are not restricted, i.e. matrix 
Bq and Bi are possibly non-sparse matrices in the LPCA procedure. We compare this 
with the restrictions that are imposed by QDESA. 

6.1. The Priority Queue with Batch Arrivals 

Consider the priority queue model where two types of customers arrive in batches 
according to independent Poisson processes with rate Xi for queue i, i = 1,2. Upon 
arrival the size Zi of a batch of type i becomes known. For each fixed i the Zi are iid 
random variables that follow a known discrete distribution: P{Zi = z) = Pi{z). 


18 


KATEHAKIS ET AL. 


Stage )Cq, the Non-Homogeneous portion 

LPCA 

QDESA 

Within this stage all transitions allowed. 

Transitions leaving K-o allowed only to ICi. 

Element Non-Homogeneous. 

Sol. Proc. on )Cq not included in algorithm. 

QSF Structure should be obeyed. 

Transitions are allowed to all higher stages. 

Element Non-Homogeneous. 

Solution procedure included for all levels. 


Stage )Ci from the Homogeneous portion 

LPCA 

QDESA 

Nearest Neighbor structure within levels. 

Nearest Neighbor to ‘NE’, ‘E’, ‘SE’. 

Element Homogeneous. 

No transitions to ‘NW’, ‘W’, ‘SW’ allowed. 

Number of stages must be infinite. 

All transitions allowed within levels. 

All transitions allowed to higher levels. 

Element Non-Homogeneous. 

Trans, to ‘W’ allowed to entranee state. 

Number of stages can be finite or infinite. 


Table 1: Restrictions for the applicability of LPCA and QDESA. 


There is a single server that serves at exponential rate p, independent of the arrival 
processes. The server serves customers at queue 2 only when queue 1 is empty, 
preemptions are allowed and switches are instantaneous. Under these assumptions 
the state of the system can be summarized by a tuple (n, j) where n (respectively j) 
is the number of customers in queue 2 (respectively in queue 1). Because we assume 
that there is no maximum for number of customers in queue 1 the sub-matrices of 
Q have infinite dimension. It is easy to see that Q is the transition rate matrix of a 
successively lumpable process with respect to the levels with Mi = 0, M 2 = 00 and 
the following within- and up-matrices, where d = (Ai + X 2 + IJ,)'. 



-d Aipi(l) 

Aipi(2) ••• 


A2P2(fc) 

0 

0 


fj, —d 

Aipi(l) 


0 

A2P2(fc) 

0 

W = 

0 /i 

—d 

, U"'' = 

0 

0 

\2P2{k) 


The matrix has its (1,1) element equal to —(Ai -I- A 2 ) and all its other elements are the 
same as those of W. The matrix D is the same as that of the process described in Section 
3.1. This model can be solved using QDESA, but LPCA is not applicable. 
















LPCA and QDESA 


19 


6.2. Longest Queue Model with non-homogeneous arrival rates 

We will extend the model discussed in Section EJ in such a way that now two types of 
customers arrive according to independent Poisson streams, with rate Ai and A 2 . There is a 
single exponential server with rate /r > Ai + A 2 . Note that the fact that the arrivals have a 
different rate implies that the state space description used in Section [3.21 does not induce a 
Markov chain. Therefore, we now let the state be specified by a tuple (n, j) where j denotes 
the number of customers in queue 1 and n the number of customers in queue 2. The buffers 
are of size M and I respectively and can be either finite of infinite. The transition diagram is 
displayed in Figure Eland the level partition is highlighted by the grey background. It is easy 
to deduct that this is a DES process where the level sets C are formally described as follows: 

M I 

-Cm = U - 1)} U IJ {{m - 1,1)} U {(m,m)}. 

n = m i=m 


State (m, m) is the entrance states for the set With this different arrival rates, LPCA 

can not be used, while QDESA"*' can be used. Note that the rate matrix Rm depends on the 
level m. 



Figure 3: Longest Queue model. 
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